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ABSTRACT 

A model for educational supervisors which attempts to 
link management theory to learning is demonstrated. With teachers 
today having greater autonomy in selecting appropriate content and 
methods, supervisors should focus on two tasks: they should become 
more involved with teachers in selecting goals and become more adept 
in monitoring the development of pupils. Selected characteristics of 
pupils and classrooms, indicators of classroom environment, and 
measures of achievement and attitudes of over 1,100 students in 
grades nine and ten mathematics classes were collected. Results 
indicated some areas for supervisory action. 0*rerall achievement of 
students was strongly related to student characteristics, indicating 
that schools do little to equalize the various advantages of children 
or to assist individuals to achieve a high level of competence. 
Second, classroom environments, as measured by Walberg's Learning 
Environment Inventory, were also directly related to achievement. If 
climate, influenced both by teachers and pupils, is related to 
achievement, teaching method, as identified in this study, is not. 
Attitudes of students toward mathematics was not related to any other 
variable selected for the study. There was evidence to suggest that 
such attitudinal goals were largely ignored by teachers of 
mathematics. (RC) 
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PARADIGM FOR EVAXUATION 
IN THE HIGH SCHOOL 



ABSTRACT 

The purpose of this paper is to demonstrate a model 
for educational supervisors. The model attempts to link 
management theory to learning. 

Given that teachers today have greater autonomy in 
selecting appropriate content and methods, it is suggested 
that the supervisor's role focus on tv/o tasks. Supervisors 
should become more involved with teachers in setting goals; 
supervisors must become more adept in monitoring the 
development of pupils. 

The paper reports on one approach to monitoring 
achievement 0 Selected characteristics of pupils and 
classrooms, indicators of classroom environment, and 
measures of achievement and attitudes of over 1100 students 
in grades 9 and 10 mathematics classes were collected. 

The results in this example indicated so^ne areas for 
supervisory action. Overall achievement of students is 
strongly related to student characteristics, indicating 
that schools do little to equalize the various advantages 
of children or to assist individuals to achieve a high level 
of competence. Second, classroom environments, as measured 
by Walberg's Learning Environment Inventory, are also 
directly related to achievement • This is related to 
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Likert's theory that organisational cliinate itself is an 
intervening variable which predicts later achievener.t in 
production. 

If climate, influenced both by teacher and pupils, 
is related to achievement, teaching method, as identified 
in this study, is net. 

Attitudes of the students toward mathematics, as 
measured by scales produced for the International Study of 
Achievement in mathematics, was not related to any other 
variable selected for xhe study. Althou^jh there may be 
some reason to doubt the validity of these scales, there 
is evidence in this study to suggest that such attitudinal 
goals are largely ignored by teachers of mathematics. 
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CHAPTER I 



THE PROBLEM 

I. INTRODUCTION 

A rajor characteristic of modern Western societies 
is the sweeping change in the field of education. Public 
education has emerged as one of the largest items of 
national expenditure. Teachers are expected to be university- 
trained and to possess a variety of sophisticated skills. 
The managers and administrators of this enterprise must 
have the expertise to manage such a series of institutions 
which encompass up to one third of the total population 
either as employees or clients. 

In spite of the importance of public education an 
effective system of evaluation has not yet been developed. 
This statement does not imply that education and educators 
have not been evaluated. They have been and they are 
today. The problem lies in the lack of systematic knowledge 
of the links between the various components of the 
technology (means) of education and its goals. Furthermore, 
educators, especially those closest to the pupil, have been 
reluctant to specify their goals with any degree of clarity 
and specificity. 
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On the other hand, educators are fond of saying 
that education is change. This makes the educator an 
agent of change. If the purpose of education is to bring 
about change in the learner (in the form of growth, 
development, maturity, new knowledge, attitudes or skills) 
then educators strive to bring about desired changes. 
Thus the teacher must assume that his efforts will lead 
to changes that are predictable , i.e. that he has definite 
goals which are achieved when the pupil exhibits the 
desired new behavior. 

Extended professional training of teachers and 
increased levels of inservice training are oriented not 
so much toward instructing the teacher in what he should 
teach, but more in understanding the pupil, his learning 
processes, and how to guide these processes so that they 
result in the desired ends. 

Clearly, today's professional teacher is expected to 
be able to state his expected outcomes, and to stucture 
his strategies to obtain them. 

These statements hold true with any teaching method. 
The teacher may use a traditional expository method, or, 
in the case of the open school educator, manipulate the 
enviror- -nt so that the child may freely learn. Both 
have some ends in view. 
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II. STATEMENT OF THE PROBLEM 
This pro.iect was based on the mode: action 
research. It was aimed at applying theoretical models 
to real life problems in functioning educational orga- 
nizations • 

The problem of the project was concerned with the 
changing role of educational supervisors from that of 
inspectors of standardized educational programs to that 
of monitors and evaluators of flexible curricula. It was 
designed to provide administrators who are in charge of 
instructional programs with a generalized model of super- 
vision and evaluation which focused on the development of 
educational programs. In other words, it was designed to 
utilize a model of educational programs which demonstrated 
the location and impact of supervisory activity along with 
operational examples of data gathering techniques necessary 
for establishing an effective monitoring system. 

Since a major activity of the instructional supervisor 
centers around improving the learning environment of 
classrooms, the study focused on a well-developed model of 
classroom management, the Mastery Learning Model, 
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III. THEORETICAL FRAMEWORK 

Management of Education 

In general terms, the task of management is to 
integrate human effort, resources and facilities toward 
common goals. The responsibility of management with 
respect to goals is related to the statement of goals, the 
coordination of effort toward these goals, the monitoring 
of effort (supervision) to see that activity is actually 
leading to the accomplishment of goals, and the assessment 
of the results in the light of the stated goals. 

The above functions must be carried out in every 
effective organization. However, the ways in which they 
are carried out will vary from one organization to another. 
For instance, the manager does not necessarily define the 
goals, but he has the responsibility to see that such 
goals do exist. 

Another important fact is that goals are never fixed. 
Organizations can alter them at any time. In fact, it is 
often as a result of the monitoring process that the need 
to change the goals is discovered. 

It was long ago discovered that a bureaucratic- 
industrial model of management was not effective for 
schools, ThuSf specific objectives and prescribed curricula 
mandated by a Department of Education, followed by inspecto- 
ral visits of classroom activity culminating in departmental 
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examinations were gradually abolished in Canada during 
the 1960* s. The standard curriculum did not allow 
sufficient flexibility to meet local needs and the needs 
of individual learners in specific classroom contexts; 
departmental examinations were not adequate measures of 
the goals which local schools, in the task of coping with 
local conditions, were attempting to achieve. 

The recent past has seen the educational community 
striving to build a new and effective programme of educa- 
tional management. Major units such as the Ministry of 
Education and regional school boards have devised general 
goals which are amenable to int^^rpretation by schools and 
teachers. Within these general ^v)licies, the teacher may 
select a number of specific objectives to meet local needs. 

At the present time, teachers in many jurisdictions 
are struggling with the task of developing specific 
objectives that will be suitable for the pupils under 
their care and at the same time conform to the policy and 
philosophy of superordinate units. This is a difficult 
task and progress is slow. Few schools today have an 
adequate set of suitable and useful objectives. Teachers 
attending workshops dealing with objectives often report 
that the task is difficult, challenging, and frustrating. 

As teachers define their objectives, they can analyze 
their teaching methods to see if they are appropriate, and 
study the achievement of pupils to see if the objectives 
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are obtained. This can be followed by a period of 
adjustment of goals and of teaching strategies until 
aims, programs and results are in harmony. Only then 
will meaningful managerial evaluation of programs be 
possible, and the allocation of resources be rational. 

A problem faced by many educational supervisors 
is the lack of a suitable monitoring system. No manager 
can succeed in a field as complex as the field as education 
without one. By monitoring system we mean a system of 
inspection, review and information relative to the starting 
point of pupils, the programs, the progress toward goals, 
the achievement of goals, and the needs of the community. 
More specifically, with reference to the instructional 
program, the educational manager (or managerial team which 
could be composed of teachers organized in a collegial 
relationship) must have access to current and reliable 
information concerning antecedents of learning (ability, 
attitudes, background of the pupii)j processes (learning 
experiences, pupil-teacher interaction, curricula, social 
climate, leadership) J and outcomes (results of the learning 
process, achievements, new attitudes, abilities and 
understandings, as well as "side effects"). This calls 
for an efficient information system. It is safe to say 
that no complete, generalizable information system for an 
educational system has yet been devised, a highly developed 
system of evaluation for the purposes of educational 
management is required. 
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In order to implement an efficient information system, 
educational managers need a conceptual model for understanding 
educational programs. Such a model should organize variables 
into a logical system, guide data-gathering activities, and 
provide educational managers with information relative to 
areas of supervisory activities which would be expected to 
have an impact on learning. 

Model of Educational Programs 

One common conceptualization of educational programs 
is the input-process - output model (Stake, 196?; Astin and 
Panos, 1971). The research reported in this paper utilized 
Walberg's Model (1970) which is an attempt to use the input- 
output formulation for research and evaluation on instruction. 
Walberg's model is based on the following equationi 

L = f (I,A,E) 
where 

L = learning 
I = instruction 
A = aptitudes 
E = environment 

Aptitudes refer to talents, skills, aspirations, and 
potentials for growth and learning that the student brings 
into the educational program. These input characteristics 
of students may affect output directly since performance 
tends to be stable over time, or student input characteris- 
tics may affect outputs indirectly by influencing and/or 
interacting with educational transactions or operations. 
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The most general academic aptitude, measured intelligence, 
typically accounts for about 50 percent of the variance in 
school achievement. Measures of the home environment usually 
account for about 65 percent of the variance in standardized 
tests and about 60 percent of the variance in intelligence 
(Wolf, 196k; Dave, 1963). 

Two elements of Walberg's model, instruction and 
environment, occur at the process level in educational 
programs. These process variables include all the contextual 
variables that character ? an educational program. The 
various educational process variables have direct effects 
on output. Recent research has demonstrated that environ- 
ments of secondary school physics classes account for 
from 10 to 37 percent after various aptitudes are partialled 
out (Walberg, I969). 

Thus, there appears to be little variance in learning 
left to be accounted for by instructional variables after 
considering the effects of aptitudes and classroom 
environment during instruction. This provides a possible 
explanation for the general finding that different 
instructional strategies do not differ from one another 
in their effects on students (Stephens, I968), 

The third component of the model, outcomes or learning 
in Walberg* s Model, refers to the objectives or ends of 
instructional programs 1 students* achievements, knowledge, 
skills, aptitude for future learning, values, and other 
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behaviors that are influenced by an educational program. 
Implicit in the model, is the idea that any analysis of 
educational programs should include not only the goals of 
the program, but also an evaluation of its "side effects", 
A program may have strong positive effects on some areas 
of learning and negative effects on other areas'. 

The conceptualization of educational programs in 
terms of inputs, processes, and outputs, and the results 
of research relative to this formulation have important 
implications for educational supervision and evaluation. 
Since the educational decision-maker can do little to 
change input characteristics of students which affect 
output variables, the educator is primarily interested 
in the relationship between processes and outputs. The 
problem is to select educational processes which maximize 
student performance on outcomes. Knowledge regarding the 
process variables which have a significant influence on 
output variables is necessary if supervisors are to focus 
their efforts on areas which have a substantial influence 
on student learning. Thus, research which is directed at 
determining the relative effect of different process 
variables (environmental and instructional) is required 
in order to provide direction for educational decision- 
makers and supervisors. 
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In this project, the Mastery Learning Model (Bloom, 
1968) was used to operationalize instruction and the Learning 
Environment Inventory was used as an operationalization of 
environmental variables. 

The next sections discuss classroom environments and 
the instructional model. 

Classroom Environments 

It has long been recognized that the effectiveness 
of groups is influenced by the psychological climate which 
permeates. This is the "tone" or "feel" one can sense after 
meeting with a group or visiting an institution. The 
performance of groups was related to the group climate 
in the early set of studies at the University of Ohio 
(Hemphill and Westie, 1950), and more recently by Likert 
(1967). 

The field of educational research has also been 
concerned with this dimension. Some studies have attempted 
to link the organizational climate of schools (Halpin, 1966) 
to a variety of administration and teaching variables. More 
directly, a variety of environmental concepts have been 
developed which appear to influence learning. Prom the 
early work of H. H. Anderson (19^6) and associates to the 
more recent research of Pace and Stern (I958), Walberg and 
Anderson (1968) and Anderson (I969) it has been shown that the 
psychological climate of the classroom is related to student 
learning. 
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The measure selected for this study was the Learning 
Environment Inventory (LEI) developed by Walberg and 
Anderson for the evaluation of the Harvard Project Physics 
(Welch, 1969). The LEI was patterned by Walberg on 
Hemphill's (1956) Group Dimensions Description Questionnaire , 
an instrument which tapped Ik group characteristics. This 
instrument was one of the early tools of the Ohio leadership 
study group which conducted one of the most extensive factor 
analytic studies of small adult groups. The scales of the 
LEI were subjected to a number of content, item and factor 
analysis tests and were subsequently revised. (Anderson, 
I97OJ Walberg, 1971). The final version was prepared by 
Anderson (1971) who added a fifteenth scale. The scale is 
fully described in Chapter II. 

The early versions of the LEI were found to be related 
to student learning in the Harvard Project Physics 
evaluation studies, as mentioned above. What is of greater 
interest, is the fact that the scales also discriminated 
between teaching methods. That method does influence 
climate has long been reported in the research literature 
(H. H. Anderson, and Brewer, 19^6). With respect to the 
LEI, Anderson, Walberg and Welch (I969) found that the 
overall climate of classes using the Harvard Project Physics 
materials was different from that of the classes using other 
instructional materials. It should be noted that the 
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teachers using the experimental materials had received 
special summer training. As the investigators had 
predicted, there were differences between the two groups 
on the two scales specifically designed to evaluate the 
experimental program; students in the experimental classes 
rated their classes as significantly lower in Difficulty 
and higher on the Diversity scale. 

The study of learning environments is important not 
only because such environments are related to learning. 
Researchers have long ago learned once a change has been 
introduced and long before there are specific outcomes 
stated as ends, there are changes in the perceptions of 
the organizational members. This has been demonstrated 
in a variety of organizational settings by Likert (1967), 
He indicated that changing managerial patterns are first 
reflected in the attitudes of employees, and that such 
evidence is an important indicator to the manager. 
Moreover, these changes in attitudes will have a definite 
pay-off within a predictable period of time in terms of 
higher profits, less waste and lower turn-over. Similarly, 
such data in schools should be examined to judge the 
progress of a program, for changes in the perceptions of 
the environment will show up later in terms of student 
learning and student attitudes. 
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Objectives and Learning 

Learning is a process of growth and development. 
The purpose of education is to direct such development 
toward desired goals. It follows then that clearly defined 
goals should be an important seg^rment of the instructional 
process. Curriculum specialists since Tyler (19^9) have 
made goals the primary ejlement of their curriculum models. 
More recently there has been considerable emphasis in the 
educational literature on behavioral objectives (Mager, I962) 
Whereas most educators seem to agree with this point of 
view, there have been some who have questioned the value of 
behavioral objectives, Eisner (196?) points out that 
whatever the logical arguments in favor of behavioral 
objectives, there has been little or no research of their 
value in learning. This study did not limit itself to a 
study of behavioral objectives, but is concerned with any 
objective which is clearly stated and understood by those 
concerned , 

The term objectives have been given many meanings. 
For the moment let us define them generally as "those 
things we want students to know, to perform and to appreciate" 
Whereas all teachers do have some goals for their teaching, 
they are often the informal, unstated, intuitive, unexamined 
goals. As such they often have little impact on the academic 
achievement of students. In other words, the goals, not 
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being formally studied, are not always logically related to 
classroom procedures, student activities and evaluation. 
Two research examples demonstrate the problem, 

Pophani (1971) compared the learning of two groups of 
high school classes. One group was taught by their regular, 
certified, experienced teachers. The others were taught by 
a group of university students who had never taught before 
and who had received no instruction in methods of teaching. 
Each group was instructed to give a series of classes to a 
number of matched social studies high school classes. At 
the end of the experiment, it was found that the experienced 
teachers did not appear to be more efficacious than the uni- 
versity students. The experimenter, a noted authority in 
the field of educational evaluation, concluded that the 
teachers did not show superior teaching results because 
they were not accustomed to using "criterion-referenced" 
teaching techniques, i.e. basing teaching on established 
objectives . 

A study recently completed at the University of Ottawa 
by Connelly (1972) is also enlightening. A sample of grade 
twelve teachers from secondary schools in Ottawa indicated 
that although there was wide agreement by teachers on a 
large number of possible and suitable objectives for their 
courses, the teachers reported that they evaluated only a 
small number of these, and most of these were at relatively 
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low cognitive levels. His study is all the more striking, 
since he asked teachers to report not only those objectives 
evaluated in formal testing situations, but also those 
objectives evaluated in informal, casual ways. 

Bloom (1971) recommends that, in addition to establishing 
a set of over-all goals or intents, each teacher specify a 
set of outcomes for each unit of his course. Such a unit 
would be covered in a period of two or three weeks. These 
objectives would be made known to the students; possibly 
these objectives could be discussed with students and 
consequently modified. 

The research on this method of providing objectives 
to students is mixed, Duchastel and Merrill (I973), in 
reviewing a series of studies on the topic, concluded that 
providing objectives to the student does aid learning in 
some cases and does not cause any harm, 

Carroll hypotheses . Objectives are important to the 
processes of education, teaching and learning. However, 
identifying them does not automatically lead to improved 
performance in our current academic institutions. Some 
scholars would link that process with three other elements 
in the teaching and learning processes 1 (1) expectations 
(2) the nature of scholastic aptitude and (3) student control 
over learning. Each of these in turn is linked to the Carroll 
hypotheses (Carroll, I963), 
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John Carroll, a noted Harvard psychologist, rejects 
the notion that scholastic aptitude is an innate, prede- 
termined ability to learn. Such a concept consigns half 
our population to "below average" levels of achievement 
automatically. He defines aptitude as a function of the 
amount of time required by the learner to attain mastery 
of a learning task under ideal learning conditions. The 
acceptance of this definition means we must revise our 
expectation that a given proportion of each class must 
fail. They will fail if, and only if, they are constrained 
to one rigid time-table. Under present conditions the 
correlation between aptitude scores and achievement scores 
are usually about +.70. This correlation can be reduced to 
almost zero if varying learning methods and variable amounts 
of time were available so that up to 9f;^ of all secondary 
students could achieve mastery. The review of empirical 
studies by Duchastel and Merrill (1973 t p.62) indicates 
that when students can control the amount of time they spend 
learning in addition to knowing the objectives, learning is 
greatly enhanced. Paradoxically, learner control also 
greatly reduces the learner time required. 

Formative evaluation . Evaluation should be linked to 
goals. Traditional evaluation in school has emphasized the 
competitive nature of our social system in that students are 
ranked, compared to "national" norms, or located at some 
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TABLE I 

FORMATIVE AND SUMMATIVE EVALUATION 



SUMMATIVE EVALUATION 

Formal evaluation techniques. 

Aimed at student assessment at 
the end of a course or topic when 
no subsequent changes in treat- 
ment for that learning will be 
made. 



Samples a relatively large 
block of content. 

Concern of the administrator. 

Provide information to the 
administrator regarding the 
success of students. 



Focus on the group. 

Norm-referenced ( interpreted 
in terms of a reference group; 
concerned with the competency 
level of the individual relative 
to a group of students with 
similar characteristics). 

Description of the distribution 
of test scores on the total test. 

Descriptive (results used to 
describe and evaluate students » 
usually for administrative 
purposes) . 

Used as part of the grading 
process . 



FORMATIVE EVALUATION 

Informal evaluation techniques. 

Aimed at evaluation of student's 
learning during a course when 
changes can be made in the 
strategy of subsequent inst-^'*' 
tion on the basis of curr 
attainment. 

Samples a relatively small 
block of content. 

Concern of the teacher. 

Provide information to teachers 
and learners regarding the 
success of the instructional 
program. 

Focus on the individual. 

Criterion-referenced (interpre- 
ted ir terms of absolute 
criterion scores i concerned 
with the competency level of 
the individual relative to 
some standard ) , 

Analysis of accuracy of item 
responses. 

Prescriptive (results used to 
diagnose weaknesses and strengths 
of individual students). 



Used as part of the teaching 
learning process. 
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percentile rank on a normal curve. Thus in education we 
casually place stiidents in a massive zero-sum game where 
only one or a select few can win. 

Formative evaluation is Stake's (196?) term to designate 
that form of evaluation which indicates if desired goals are 
achieved. It is criterion-referenced rather than norm- 
referenced. The standards indicate accomplishment of goals 
rather than surpassing others. Thus, teachers can share 
with students the identification of evidence which indicates 
mastery. 

Carried to its logical conclusion, Bloom (1971) states 
that formative tests should not be assigned a grade. 
Students should not be "graded" as they learni they need 
to know when they have indeed mastered <un objective. 

Consequently, effective instruction should include 
frequent testing to guage progress toward a goal and to 
indicate changes in the learning process. 

The experience of the Unf.versity of Chicago group 
with Bloom (1971. ch, 3) indicate that class performance 
is little affected by formative evaluation alone. After 
each test, there must be follow-up or remedial work. In 
one small study, a group of students received a great deal 
of such direction and they were assisted by non-specialists, 
often their parents. This group achieved well and le 
correlation between their aptitude and their achievement 
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was greatly reduced while that of a comparison group 
was .95 CBloorr., 1971). 

Summative evaluation , Educators must evaluate to 
make administrative decisions v/hich are distinct from the 
decisions teachers make in the student-learning process. 
Superintendents must conduct system-wide analyses; 
counsellors must guide students? boards must grant diplomas 
Such formal evaluation does not imply any imr.ediate change 
in tiie pupil's programme. These are end-of-year or end-of- 
program assessments. The evaluator rather than the teacher 
usually is responsible for this assessment. 

There are 5 purposes of goals in the learning process: 
(1) goals provide direction; (2) goals provide organisation 
to the subject matter; (3) goals serve as a management guide 
in the proper use of student time; (k) accomplishment of 
intermediate goals serve as rewards, and reinforce motivatio 
(5) results of testing intermediate goals indicate 
re-structuring of the learning process to favor achievement 
of goals. 

Learning theory and management theory . Likert * s (I967) 

theory of management is similar to that of xho teachinr 

model suggested above. He insists that goals be high goals; 
that tiicv be shared; that employrtcs be free to cleterniined 
the best way to achieve goals; that employees be given 

freedom to organize xheir time; and that wages be tied to 

the accom shment of objectives.' 
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The elements of the Mastery Learning Model (MLM) 



have been suggested above. The model was introduced 

by Bloom (I968). It consists of the following partsi 

It Organisation of the course into manageable 
blocks which require two to three weeks of 
teaching time, e.g. a chapter of a text. 

2. Establish suitable criterion-referenced 
goals for the unit. They often will be 
communicated to the stixdents. 

3. Provide frequent formative tests. Do not 
use these test results to calculate grades. 
These tests should be a means of frequent 
feedback. 

^. Provide remedial work, supplementary 

materials, tutorial assistance, or other 
alternative learning modes for those 
students whose tests results do not 
indicate mastery. 
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IV. CONCLUSION 
The superintendent's role is that of the educational 
manager. As such he requires a set of goals, an information 
system which monitors not only the achievement of those 
goals but also of key variables which influence the accom- 
plishment of these goals. These variables include a set of 
variables which he cannot control but which are important, 
e.g. the parents' educational background and aspirations, 
the pupils' aptitudes. There are also variables over which 
educators either control or partially influence, e.g. 
selection of instructional goals, instructional strategies 
and classroom climates. 

The mastery learning model is only an example of an 
instructional strategy but its elements should be found 
in all the definitions of valid educational technologies. 

The teacher working with students similarly requires 
a set of instructional goals and a monitoring system. As 
is the case with all efficient monitoring systems, the 
information should be used to alter the teaching and 
learning strategies to lead to effective accomplishment 
of goals. 

The teacher does not work in a sterile climate. He 
influences and is influenced by the psychological climate 
of the classroom, which in turn is strongly related to 
student outcomes of cognitive learning and of attitudes. 
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This Climate is influenced by social values, norms, and the 
personalities of the individuals involved? it is also 
influenced by teaching method (H. H. Anderson; Logan). 

The following chapters detail p.ome attempts to verify 
the arguments posited in this chapter and also demonstrate 
a method and process for evaluation of secondary school 
pi'ograms . 
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CHAPTER II 
PROCEDURES AND DESIGN 

I . INTRODUCTION 
The purpose of this chapter is to outline the 

procedures used in our attempts to verify the linkages 

among the variables defined in the first chapter. 

The second part describes the research scales and 

instruments used in this study to operationalize our 

concepts . 

The third part reviews the procedures we used to 
select the sample, collect the data and to describe the 
workshops. These were designed to review with teachers 
the role and nature of objectives in teaching and to 
acquaint them with the Mastery Learning Model. In this 
section the sample is described. 

Limitations of the Study 

Two limits of the study should be noted at this point. 
The first is that there is some difficulty in determining 
the instructional strategy of teachers in a study such as 
this. There was no extensive training for teachers? no 
observational techniques were attempted. Thus any attempt 
to compare instructional strategies will be difficult as 



there will be little evidence that the two fcroups ara 
indeed different. 

The second limltaxion is also serious, When this 
study was begun, the intention v/as to use as an outcome 
variable a test specifically designed to neasure the 
achievement of matheiriatics cf students in Ontario 
secondary schools. Although such a test was in the 
development stage, it was not available for use at the 
time of this study. Consequently, the Stanford Achievement 
Test (SAT) v/as used, A description of the SAT is given 
below , . 

II. RESEARCH INSTRUMENTS 
The plan for gathering data was developed fror; the 
input-process-output model of educational program??:. 
Input characteristics of students were measured by means 
of the School and College Ability Test (SCAT) Series II, 
a measure of academic aptitude, and a 3iog!;raphical 
Inventory v;hich measured family educational background, 
dir.like for schooling, and career plans. The process 
variables were indexed by means of the Learning Environment 
Inventory , a measure of the social environment of school 
classes, and the Mathematics Class Inventory , a question- 
naire v/hich was designed to obtain students* perception 
regarding use of the Mastery Learning Model in their 
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mathematics classes. The output variables were measured 
by means of the Stanford Achievement Test , Mathematics ^ 
Part A , a measure of cognitive achievement in Mathematics, 
and the School Mathematics Inventory , a questionnaire used 
in the International Study of Achievement in Mathematics 
(Husen, I967) to measure attitudes toward mathematics. 
A detailed description of each of the above is presented 
in what follows. 

School and College Ability Test (SCAT) Series II , 

The SCAT Series II is designed to measure verbal 
and mathematical ability. The test yields three scores 1 
a Verbal score, a Mathematical score, and a Total score 
based on a combination of the Verbal and Mathematical 
scores. The Kuder-Richardson Formula 20, used to estimate 
the reliability coeficients for Form 2A and Form 3A, range 
from .87 to .9^. For purposes of analysis, each of the 
three saw scores were changed to converted scores and 
the latter were used in all statistical analyses. 

The validity of the SCAT Series II for predicting 
academic performance has been demonstrated in a number 
of studies. The SCAT Series II scores were correlated 
with the Verbal and Mathematical scores on the Scholastic 
Aptitude Test of the College Entrance Examination Board; 
the resulting correlations based on 2kk individuals, 
between the Verbal and Mathematical scores for the two tests 
were .83 and *86 respectively. 
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B iographical Inventory (BI) 

Following the work of Walberg (1970), the project 
team developed a fourteen item inventory to collect the 
following data I sex, age, parents' education, the 
student's attitude toward school in general and to mathe- 
matics in particular, the student's willingness to discuss 
future career plans with the guidance counsellor or other 
adults, previous achievements and future plans. 

Data from the BI were factor analyzed and three 
factors were extracted. The first factor dealt with home 
background and consisted of items dealing with the 
education of the father and mother. The second factor 
was identified as dislike for schooling. This factor 
consisted of items measuring the time spent on homework, 
the time spent with peer groups, liking for school and 
liking for mathematics. A high score on this factor 
indicates a dislike for school, little time spent on 
homework and a great deal of time spent with peer groups. 
The third factor is labeled future planning. This indi- 
cates that the student has discussed various career 
possibilities with adults. The factor structure is shown 
in Table II. 

Although there are no reliability or validity data 
for these items, they are simple direct questions which 
have been used successfully in many studies. The factor 
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TABLE II 

FACTOR LOADINGS FOR THE BIOGRAPHICAL 
INVENTORY BASED ON A QUARTIMAX ROTATION 



Items 


I 


Factor 
II 


III 


Ti2 


113. Father's education 


.88 


-.09 


-.05 


.78 


11^. Mother's education 


.88 


-.06 


.01 


.77 


119. Time spent with gcmg 


.08 




.11 


.32 


120. Time spent on homework 


.15 




.16 


.35 


124. Like mathematics class 


.03 




-.13 


.52 


121. Like School 


.05 




.11 


.36 


122. Discuss career plans 
. . .with counsellor 


-!o4 


.12 


.81 


.67 


123. ...with other adults 


-.00 


.14 




.71 


Eigenvalues 


1.57 


1.49 


1.41 





N = 560 
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structure is based on a large enough population to warrant 
confidence in its use. 

Learning Environment Inventory (LEI) 

This instrument was designed to measure the psycho- 
logical climate of a class as perceived by the pvpils 
within it. The final version contains 105 statements 
describing typical school classes. Each student expresses 
his agreement or disagreement with each statement on a 
four point scale. 

Most of the items were based on the Group Dimensions 
Description Questionnaire of Hemphill, (Hemphill and 
Westie, 1950), The original authors added two scales 
to evaluate the Harvard Project Physics (HPP) courses i 
Difficulty and Diversity, The fifteen scales of the LEI 
are defined on Table III, 

The instrument has proved to be useful to the HPP 
team and in subsequent studies in a wide variety of 
subject areas with diverse populations of students. 
Several reliability scores are available. For individual 
respondents, the Alpha scores for each scale range from ,53 
to ,82, (Anderson and Walberg, 1972), Test re-test corre- 
lations for each scale range from ,^3 to ,73 (ibid,). For 
classes, the intraclass correlations range from .3I to ,92, 



39 



TABLE III 

LEARNING ENVIRONMENT INVENTORY SCALES 



1. Cohesiveness i The feeling of intimacy that has 

developed 'as a result of several 
individuals interacting over a period 
of time, 

2. Diversity i The extent to which the class provides for 

a diversity of pupil interests and activitie 

3. Formality I The extent to which behavior within the 

class is guided by formal rules. 

4. Speed t The rate of progress of the class. 

5. Environment t The physical environment, including the 

amount of space available and the type 
of recreational equipment. 

6. Friction t The extent to which conflict may affect the 

behavior of the class. 

?• Goal Direction ! The recognition of goals and their 

subsequent acceptance by the group. 

8. Favouritism ! The extent to which pupils possess a 

low academic self^concept . 

9. Cliqueness i Airns at revealing the extent to which 

cliqueness exists in a classroom and its 
influences on social interaction. 

10« Satisfaction ! The extent to which students like or 

dislike their class. 

11 • Disorganization ! The extent to which students consider 

their class to be disorganized. 

12. Difficulty ! The relative perceived difficulty levels 

of various courses. 

13. A pathy ! Complements the cohesiveness scale, but also 

indicates if individuals within the class feel 
any affinity with class activities. 

1^. Democratic : Indicates the extent to which a "democratic" 

atmosphere exists within a classroom. 

15. Competitiveness i The degree of competitiveness existing 

within the class. 



40 



The main comparative study of HPP (Anderson and 
Walberg, 1972b) contrasted randomly assigned groups for 
a true experiment and the results of the LEI scores were 
as predicted, in that the HPP classes are perceived as 
less difficult and the activities more diverse. Other 
analyses of the data revealed that the HPP was seen as 
providing a more stimulating environment, less cliquish- 
ness and friction among class members, more democratic 
and cohesive behavior than other classes. (Anderson, 
Walberg and Welch, I969). 

In other studies with the LEI, it was found that 
the LEI is sensitive to a variety of classroom climates 
which are associated with a variety of environmental, 
social and organizational factors, (Anderson and Walberg, 
1972) as well as being linked to classroom learning 
(Anderson and Walberg, I968). In their study, the IQ 
of students accounted for 16% of the variance in learning 
when the effects of pretest scores had been removed. The 
sum of all the LEI scales accounted for between IJfo to h6% 
of the variance in learning, that is, considerably more 
than IQ alone. 

Overall, the LEI can be considered as a reliable 
instrument for this study, and it has been demonstrated 
that it adequately accounts for social, environmental and 
climate factors in the classroom, and for student learning. 
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Mathematics Class Inventory . 

The Mathematics Class Inventory was developed by the 
research team. It consisted of six questions which were 
concerned with the major variables of the Mastery Learning 
Model. It was designed for administration to students to 
provide the researchers with feedback data relative to the 
use of mastery learning techniques in both the experimental 
and control classes. It was felt that this information was 
necessary because many teachers use aspects of mastery 
learning in their teaching even though they do not have 
specific knowledge regarding the Model and these teachers 
could be working in the control classes. Also, it was 
necessary to have information regarding the impact of the 
use of the Mastery Learning Model in experimental classes 
from the point of view of students. 

Tne inventory with the pupil responses in terms of 
percentages is given on pages 88-89 of this report. 
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STANFORD ACHIEVEMENT TEST (SAT) i HIGH 
SCHOOL MATHEMATICS TEST FORM W - 1Q6S 

The need to select a general standardized achievement 
test was described in the INTRODUCTION to this chapter. 

This test was developed in the early 60's during the 
"New Math" era and it does represent a measure of broad 
mathematical development. 

The test is divided into Part A and Part B with 40 
and 3k questions respectively. Part A is general in nature, 
and pertains mainly to Grades 8, 9 and 10, while Part B 
covers mainly the latter years of High School. 

The breakdown in areas covered is as follows 1 





No. of 

Items 


% 




42 


58.3 


Geometry 


15 


20.6 


Probability and Statistics... 




5.5 


Trigonometry 


2 


2.75 


Matrices and Determinants.... 


2 


2.75 




2 


2.75 


Arithmetic 


2 


2.75 




2 


2.75 



From this breakdown, the lack of sufficient examples in 
specific areas becor.es apparent, and its validity then 
becomes a matter of sufficient content in specific areas. 
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The test is reviewed by Broswell and Wilson in Burc::, 
r.iGntal MeaGureraents Yearbook , (Puros, 19?2). Both autnorT; 
claim that it is useful, but that its validity for specific 
mathematics programmes is doubtful. Wilson, states that 
it is more valid than most oxher available mathem.atics 
achievement tests. 

Since the sample of students in this study v;as limited 
to first and second year students, Part A of the test was 
used. Raw scores were used for the statistical analyses. 

SCHOOL f.:ATHE[>!ATICS INVENTORY 

The School Mathematics Inventory nicasarcs 
the attitudes of students concerning the nature ci 
Mathematics. This instrument was developed for the Interna- 
tional Study of Achievement in Mathematicn (Husen, I967). 

Each of the seven scales in the questionnaire was 
developed by postulating a continuum for each environmental 
and attitude variable. In the case of the scale concerned 
with mathematics teaching and learnin,^;, the continuum ranged 
from a teaching-learning situation which was directed at 
stimulating sxudents by means of an inquiry approaca to 
a mechanical, fornalistic mode with emphasis cn rote 
memorisation. The scale dealirig with the climate of the 
school and school learning ranged from an inquiry-oriented 
approach which was aimed at engaging students in a 
continuing process of discovery to an authoritarian, 
instructor-directed mode. 



41 



34 

In addition to the two environment scales described 
above, thq instrument contained five attitude scales which 
v/ere concerned v/ith student attitudes toward school, 
mathematics, or life. The five scales were as follows: 

1. Attitudes toward Mathematics as a Process. 

2. Axtitudes about the Difficulties of Learnin-^r 
Mathematics . 

3. Attitudes Toward the Place of Mathematics in 
Society, 

4. Attitudes Toward Scnool and School Learning. 

5. Attitudes Toward Man and his Environment. 

An underlying continuum v/as postulated in the development 
of each scale. The underlying continuum for attitudes 
toward mathematics as a process ranged from "a viev/ that 
mathematics is a fixed, formal system governed by rigid 
and unchanging rules which a student had to master to a 
view that mathematics was a subfject that was still in a 
process of development..." (Husen, 196?, Vol I, p. 112). 
In the case of the scale dealing with attitudes toward 
difficulties of learning mathematics, the underlying 
continuum ranged from "a view th^t mathematics is a subject 
which could only be learned by an elitist few to a view 
that anyone can master mathematics" (Kusen, 196?, Vol I, 
p. 113). The continuum underlying the scale measuring 
attitudes toward the place or mathematics in society ran^^^^d 
from "a view that mathematics is neither essential to a 
nation's development nor useful in meeting the problems 
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of everyday life, but rather a subject to be indulged in 
by a luxury class... (to) a view that mathematical 
knowledge and understanding is absolutely essential to 
a nation's development..." (Husen, 196? , Vol I, p.113). 
The scale measuring attitudes toward school and school 
learning was based on a continuum that ranged from "total 
dislike for school and a strong desire to leave school as 
soon as possible to a total enjoyment of all aspects of 
school life and a desire to obtain as much schooling as 
possible" (Husen, 1967, Vol I. p.113). The final scale, 
man and his environment, contrasted the view that "man 
is at the mercy of his environment and could only hope to 
secure some measure of adjustment to forces outside of 
himself, to a view that man could gain complete mastery 
of his physical and social environment and use it for his 
own purposes" (Husen, 1967, Vol I, p.113). 

The procedures followed in the development of each 
scale involved writing a series of statements for each 
scale, screening items to delete ambiguous or complex 
statements, and rating the items relative to the overall 
continuum for each scale. The items were than assembled 
and administered to a trial population. These responses 
were analyzed using Guttman Scale Analysis procedures. 
This resulted in the elimination of a number of items. The 
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coefficients of reproducibility obtained from the Guttman 
Scale Analysis ranged from •?? to •92, 

For the purpose of the research reported in this paper, 
four scales were selected as indices of output variables. 
The four scales were Views about Mathematics Teaching, 
Attitudes Toward Mathematics as a Process, Attitudes 
about the Difficulties of Learning Mathematics, and 
Attitud Toward the Place of Mathematics in Society, 

Publication of the Scale , 

For this study, the researchers purchased the right 
to use the School Mathematics Inventory from the holders 
of the copyright, Almqvist and Wiksell, Stockholm, Since 
permission was not obtained to reproduce the Scale in this 
report, there is no copy in the Appendix, Readers will 
find a complete description of the scales in volume II 
of Husen (196?), 

Ill, RESEARCH PROCEDURES AND SAMPLE 
The nature of the project required the selection of 
a sajnple of schools, teacher involvement in a mathematics 
workshop, selection of experimental and control classes, 
and the administration of questionnaires and standardized 
tests to students, A description of these procedures is 
given in this section. 
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Selection of Schools . 

In drawing up the sample for this study, there v/ere 
the usual problems encountered in conducting large research 
and development projects in education. 

It was decided to restrict the sa:nple to secondary 
schools in Eastern Ontario where the language of instruction 
was English. 

The sample of schools was selected from schools in 
four boards of education. The number of schools included 
in the sample from each board v/as proportional to the total 
number of schools under the jurisdiction of the board. The 
Ottawa Board of Education was represented by 6 schools, the 
Carleton Board of Education by 2 schools, the Renfrew Board 
of Education by 2 schools and the Lanark Board of Education 
was represented by 2 schools. 

The sampling techniques used included both random and 
judgmental sampling. The six schools from the Ottawa Board 
v/ere selected randomly. The method employed involved 
matching schools on the basis of a school index of general 
scholastic aptitude. Three matched pairs were randomly 
selected from this Board. The six schools from the 

remaining three boards were selected by means of judgrr.ental 
techniques in consultation with the regional consultant of 
mathematics. An attempt was made to select two schools 
from each board which were equal in every respect, except 
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for the possibility that one of these schools would not 
be able to participate in a mathematics workshop. 

Since it was necessary to use judgmental techniques 
it is possible that some of the experimental schools were 
more innovative than the control schools. However, we 
were not able, either through casual observation or formal 
methods, to find any consistent differences between the 
two groups of schools. 

Inservice Teacher Education ; Workshops 

The content of the workshops focused on the Mastery 
Learning Model with emphasis on using objectives and 
formative evaluation techniques. In this phase, workshop 
sessions were held with teachers of first and second year 
high school mathematics to demonstrate the establishment 
and utilization of objectives for the teaching of high 
school mathematics and to demonstrate the use of a 
number of formal or informal methods of formative evaluation 
Source material for the objectives were the Ontario Ministry 
of Education objectives for the teaching of mathematics 
and various other sources which are compatible with the 
program guide published by the Ministry. The workshops 
were directed at general techniques rather than at specific 
content. Thus, the v/orkshops did not place restraints on 
the flexibility of mathematics programs within schools. 
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The workshops were based on the following plani 

1. Presentation! "An Overview of the Mastery 

Learning Model". 

2. Presentations "Instructional Objectives" 

a) Rationale for using Instructional Objectives. 

b) Definitions of Instructional Objectives and 
the problem of specificity. 

c) The components of an Instructional Objective. 

d) The utilization of Instructional Objectives 
in teaching. 

3. Work Session 

a) Examination of examples of Instructional 
Objectives and evaluation of the quality 
of these objectives. 

b) Discussion on the use of Instructional 
Objectives in the classroom. 

c) Examination of lists of objectives and 
selection of suitable objectives for courses. 

4. Presentation! "Formative Evaluation". 

a) The mastery learning model. 

b) The nature of formative evaluation. 

c) Differences between formative and summative 
evaluation. 

d) The use of objectives for formative evaluation. 

e) Individualization. 

5. Work Session 

a) Discussion and development of techniques 
for formative evaluation in the classroom. 

b) Determination of resources required by 
teachers during the year. 

6. Establishment of Information Exchange 

a) Teachers were encouraged to develop Instruc- 
tional Objectives and evaluation items and 
forward them to the Faculty of Education. 

As the year progressed, teachers received materials 
which enabled them to evaluate their progress and the 
progress of their students. 

A number of regional workshops were conducted. The 
time required for each workshop was eight hours. Four 
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workshops were conducted during all-day sessions; in one 
case, a workshop was conducted in two half -day sessions. 
This phase of the project was carried out between October 15 
and December 15, 1972. 

At the end of the workshops, participating teachers 
were requested to evaluate the workshop using an instrument 
prepared on the basis of the content of the workshop. 
The reactions of the teachers to these workshops are 
reported in Appendix B. 

In addition, in early October, the workshop procedures 
were tested out in a trial workshop. Teachers from 
Vankleek Hill High School, Seaway Valley High School and 
a group of French-speaking teachers from Hawkesbury High 
School participated. 

Selection of Classrooms . 

After the workshops had been conducted, the researchers 
solicited the cooperation of the teachers in the experimental 
schools to agree to use the model in at least one class 
during the following semester. From among this groups of 
volunteers, we selected four classes from each school. The 
final sample for the experimental group was 2^ classes of 
mathematics I 12 at the grade 9 level and 12 at the grade 10 
level. These groups were further equally subdivided into 
advanced academically-oriented classes and general or 
terminal classes. Once again, classes from the control 
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schools were selected to match those of the experinantal 
groups . 

The total sample consisted to 48 classes and 1100 
students. According to the estimates of knowledgeable 
judges and according to ovr data, there appeared to be 
no consistent differences between the two groups of 
classes . 

Data Collection , 

Questionnaires and tests were administered in two 
sittings with each of the 48 classes. One sitting; 
involved the administration of the Stanford Achievement 
Test-Kathematics - Part A, and the SCAT-Series II, Form 2A 
in Grade lo Classes, Form 3A in Grade 9 Classes. The 
Stanford v/as administered to 2/3 of the class v;hile the 
SCAT was administered to the remaining one third. In the 
other sitting, the LEI and the Biographical Inventory were 
administered to one half of the class v/hile the School 
f^athematics Inventory and the Mathematics Class Inventory 
v/ere administered to the remainder of the class, r.;ales and 
females were proportionally represented in each segment of 
data collection. 

The order of administering sets of instrument- in the 
two settings was alternated to eliminate order effects. 
This method of collecting data was consistent with proce- 
dures used by Anderson and v;as economical in terms of 
research effort. 
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IV. SUMMARY 

The final sample consisted of approximately 1100 
students from 48 grades 9 and 10 (or equivalent) mathe- 
matics classes selected from 12 schools. Six schools 
were randomly selected and the six others were selected 
by means of judgmental techniques in cooperation with 
local and regional officials who knew the respective 
mathematics departments well. Three of the randomly 
selected schools and three other schools were invited 
to participate in a 2-day workshop for teachers. The 
purpose of the workshop was to ensure that enough of 
the sample would consciously use goals in their teaching 
as well as those elements of good teaching found in the 
Mastery Learning Model. The classes of twenty-four 
teachers who indicated that they would use the model 
the following semester were selected as the experimental 
group. These were evenly divided between grades 9 and 10, 
and advanced and general classes. Within these strata, a 
control group was randomly selected from the remaining 
schools. The numbers of boys and girls were proportiona- 
tely represented in each data collection phase. 

Since we were concerned with the effects of climate 
on other variables, the classroom was the unit of analysis, 
and all comparisons of scores were based on the class 
average , 
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The data was collected from each class in two 
sittings during the month of May. 

In one sitting, two-thirds of the students completed 
the Stanford Achievement Test-Part A (SAT) and the other 
third completed an I.Q, test School and College Ability 
Test, Series II (SCAT-II). In the other sitting half the 
class completed the Learning Environment Inventory (LEI) 
and the Biographical Inventory (BI) while the other half 
completed the School Mathematics Inventory (attitude scales 
and the Mathematics Class Inventory, which was designed to 
elicit student perception of the use of the Mastery Learnin 
Model by the teacher. 

The class means were first intercorrelated and then 
subjected to more complex tests of multiple correlation, 
regression analysis and canonical analysis. 
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CHAPTER III 

DATA ANALYSIS 
In this chapter, a report of the analysis of data 
using the input-process-output model as the framework is 
presented along with interpretations and conclusions 
based on the analysis. Readers not familiar with the 
statistical methods employed will find some helpful notes 
in Appendix E. 

I. RELATIONSHIPS IN THE MODEL 
This section gives an overview of the relationships 
between the sets of variables in the INPUT-PROCESS-OUTPUT 
model , 

Input and Output . 

Within this model, the variables selected as input 
are beyond the control of the educator. They are 
conditions within which he must work. Two sets of input 
are used in this study i 1. verbal and mathematical 
scholastic aptitude; and 2. biographical indices (a) 
parent's education, (b) dislike for schooling, and (c) 
career planning. These are related to the output variable 
namely achievement in mathematics and four selected 
attitudes. The attitudes, as defined earlier, are 



(1) viev/s about mathematics teaching (teachers are vie'.;ed 
as requiring mechanical, rote learning to encoura?;:ing 
inquiry methods); (2) views about mathematics as a proces 
(3) difficulties of learning mathematics (reverse scorinc; 
used); and (4) importance of mathematics in a modern 
society. 

Table IV contains simple and multiple correlations 
between input characteristics (aptitude and biographical 
variables) and learning criteria. Six of the twenty-five 
rinple correlations are significant. There are positive 
relationships between mathematics achievement and verbal 
aptitude, mathematics aptitude, parental education and a 
nc -tive correlation between mathematics achievement ana 
-:islike for schooling. There are also positive relation- 
sn.nf- beT.veer. attitudes tov/ard the place of mathematics 
in society ar.c verbal and mathematical aptitude. Thus, 
students who have strong verbal and mathemiatical aptitucec 
tend to have high mathematics achievement scores and tend 
to view m.axhematics as essential and necessary for zhe 
development of a nation. 

Tv/o multiple correlations were significant. The five 
input characteristics considered togethor produce a 
multiple R of .86, which indicates that ?? per cent of 
the variance in achievemenx can be accounted for by inr.ut 
variables. The five input variables also account for ?A 
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per cent of the variance in an attitude variable, attitudes 
toward mathematics as a process. Thus, the input variables 
are better predictors of cognitive than of non-cognitive 
learning criteria, 

A closer examination causes us to consider the 
possibility of revising the classification of the attitude 
scales. The first scale appears to be more a perception 
of how the teacher conducts the class; thus it is more of 
a teaching style or process variable than an output variable. 
The remainder of the scales appear to tap attitudes which 
appear to be learned at school, and thus should not be 
related to input variables such as those selected for this 
study. 

In addition to the simple and multiple correlations 
using the five input variables as predictors. Table IV 
contains five multiple correlations based on regressing 
the independent variables backwards on the dependent 
variables. This was designed to determine the significance 
of, and dependent variance accounted for by, each independent 
variable. Four of the five multiple correlations were 
significant. Once again, it is obvious that mathematics 
achievement is strongly related to the input variables. 

Conclusion . Pundits thoughtlessly state that schools 
do not make a difference. Obviously children do learn a 
great deal at school. But the quality of their learning 
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appears to be tied to their background. If input can accoun 
for so much of the variance in learninfr . then it indicators 
then schools must re-structure learning so that more 
children can achieve mastery and thus become somewhat more 
equal than when they begin school . 

Secondly since input does not account for much of the 
variance in attitudes, it indicates that schools may be 
doing a more egalitarian job in this area. 

Learning Environment and Output 



The correlations betv/een the fifteen environment 
variables and the five learning criteria are presented 
in Table V. The fifteen environment variables account for 
68 per cent of the variance in mathematics achievement and 
for 56 percent of the variance in one attitude variable, 
Views About Kathematics Teaching. Thus, the environment 
variables are good predictors of only one of the four 
attitudes toward mathematics. As was indicated earlier, 
this particular attitude variable is more process than 
output. This scale may be measuring the same phenomena 
as the LEI, 

The siraple correlations between the environment scales 
and mathematics achievement indicate that cognitive achieve- 
ment in mathematics is associated with an enviromient that 
is characterized by high scores on the Gohesiveness , 
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Environment, Satisfaction, Difficulty, and Democratic 
scales and low scores on the Friction, Favoritism, Cli- 
queness. Disorganization, and Apathy scales. Thus, the 
classroom environment that is associated with high 
cognitive achievement in mathematics is characterized 
by friendly, cooperative teacher-student interaction, 
an uncrowded room with adequate materials and books, 
students who enjoy the work of the class, a sharing of 
decision-making processes, an emphasis on treating every- 
one equally, along with well-organized classroom r dures. 

The correlations obtained between the fifteen 
environment scales and mathematics achievement are similar 
to correlations reported by Walberg and Anderson (1972) 
based on eight class means. A comparison of the correlations 
obtained in the two studies indicates that the direction 
of the relationships is similar for all variables with the 
exception of Cliqueness, 

This is the only study so far to report a significantly 
negative correlation between class means for mathematics 
achievement and Cliqueness. However, the theory underlying 
the scale as described by Anderson (1971) would suggest 
that our finding is plausible. In the study reported by 
Walberg and Anderson (1972), Cliqueness is not related to 
achievement in the physical sciences but is negatively 
related to achievement in some of the social science 
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subjects. Further Cliqueness is significantly related 
(r = -.30) to total achievement, and the correlation 
remains significant when the effects of IQ are partialled 
out (r = -.26). Thus, in general, we can conclude that 
Cliqueness is negatively related to class achievement. 
Walberg and Anderson reported four significant relation- 
ships between cognitive achievement in Mathematics and 
the L.E.I, scales; they reported significant positive 
relationships between Mathematics Achievement and Environ- 
ment and Competitiveness, and significant negative rela- 
tionships between achievement and Friction and Apathy. 
These results were replicated in the present study with 
the exception of the relationship between achievement and 
Competitiveness . 

Competitiveness is a new scale developed by Anderson 
and only recently added to the LEI. Only Walberg and 
Anderson (1972), report its use. The relationship between 
mathematics achievement and Competitiveness in the Walberg 
and Anderson Study is very strong (r = .72). They also 
report a partial correlation, controlling for IQ, between 
total achievement and Competitiveness which is significantly 
positive. This scale has good reliability. However the 
correlations between it and achievement shifts widely from 
one subject to another, even within the Walberg and Anderson 
report! mathematics, r = .72, physics, r = -.83; 
biology -.46; geography, r = -.88. since the direction of 
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the correlation for rnathi^Tnatics is the same for both stuiies 
it appears that there is a positive aL-jociatlon betv/oen 
class means in mathematics achievement and this variable, 
although this conclusion should be considered to be very 
tentative . 

The results of the baclc//ard regression reported in 
Table V indicate that nine of the fifteen multiple corre-- 
lation coeff icient:-3 were 3i^?;nif icant . In terms of accountin;?^ 
for variance, the following learning Environraent Inventory 
variables are strongest: Speed, Environment, Friction, 
Favoritism, Satisfaction, Disorganization, Difficulty, 
ApatJiy, and Democratic. 

Conclusion , Since both input variables and classroom 
environment share large proportions of the variance in 
achievement, then we may safely conclude that students 
themselves sharp responsibility for the learning clinaxe 
in the classroom. The interaction between teacher, 
teaching style, social values, pupils and facilities account 
for environment. Nevertheless, climate is strongly related 
to achievement. It may be that in education as well as in 
industry that climate does produce an eventual pay-off in 
productivity. 

In a design such as this one, it is difficult to 
state with certainty which occurs first: achievement or 
climate. The theory strongly sugger^tr: the hittc-r. 
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The LEI accounts for a significant proportion of 
the variance of only one attitude: viov.'« about inaxho;na- 
tics teaching. As was stated earlier, this appears to 
measure how the pupils perceive the predominant teaching 
style of their teacher. Thus it is expected to be related 
4;o classroom environment. 

The learning of attitudes do not appear to be related 
to climate whereas cognitive achievement is. A number of 
possible explanations could be given. The preferred 
interpretation at this time is that teachers do not have 
these as objectives for their teaching. Thus these 
attitudes are probably learned independently of the 
classroom. This su^^gests that mathematics teachers should 
be more aware of the affective domain of their sub.iect. 

Teaching I.:ethod and Out-put 

The correlations between use of the :.;astery Learning: 
Model and the learning Criteria are presented in Table VI. 
For the purpose of calculating these coefficients, Tviastery 
Learning v/as used as a dummy variable. In other words, 
classes v/hich used the Model v/ere placed in a grour^ and 
assigned a value of 1 while classes which aid not use the 
■■lodel were assigned as value of 0. The rer.ultinfr corre- 
lations are point-biserial . The results .-^iven in Table VI 
indicate that ffestery Learning was not significantly 
related to any of the learning criteria. 
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There are several possible reasons for the failure 
to obtain significant relationships. In the first place, 
student perception of the extent to which the model was 
used in the .,vo groups oi classes indicated that there 
were no substantial differences in the use of the model 
between the two groups of classes. The nature of the 
Mastery Learning Model is such that most teachers use 
some of the elements of the Model in their teaching. 
Although the workshop and related activities appeared 
to have an impact on teachers' knowledge and willingness 
to use the model (see Appendix B), these differences 
were not apparent to students. Ajiother possibility for 
the failure to obtain significant relationship s the 
fact that instructional variables such as Masti-;, Learning 
Strategies generally account for only a small portion of 
the variance in learning criteria (Stevens, I968). In 
order to have an impact, ir, struct ional variables would 
likely have to be changed drastically and even then 
considerable time would be required before the change 
would have an impact on output variables (Likert, I967). 
In this sense, the results demonstrate the need for super- 
visors to consider the time variable along with the 
difficulties involved in changing classroom techniques. 

The analysis of the Mathematics Class Inventory proved 
to be disappointing. It was designed to inform the 
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researchers if the teacjhers were using the Mastery 
Learning Models. Thd^ survey showed that almost none 
of the teachers were Using the entire model. Since goals 
were the primary concern of this study we examined that 
one question. Unfortunately there was a lack of discri- 
mating power in this item as ^Qffo of all students indicated 
that teachers did comifi^nicate goalr, to them. If 8o^ of 
the students did inde^cl receive goals, then we must 
assume that it is a ui^^versal practice among teachers. 

In attempting to study relationships between use of 
the various elements of the model, or various combinations 
of elements, we were unable to link these to any input or 
output variables. 

Since this is Contradictory to the work reported by 
Bloom (1971) and BlocK (19?1) we can only assume that our 
questionnaire lacked sufficient reliability and validity 

nd that this question Will have to await a more rigorously 
designed test to asc^r't^in use of the Mastery Learning Model. 

Input-Process-Output 

The results of X^e backwards multiple regression 
reported in Tables IV ^nd V indicated that thirteen 
variables were significantly related to the dependent 
variables considered together. To determine the relation- 
ship between these thirteen variables considered together 
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and the five learning criteria, canonical analysis was 
used. The analysis resulted in one significant canonical 
variate (rc = .92). This implies that there is one factor 
which links the independent and dependent variables into 
one construct. In other words, the canonical analysis 
provides a highly generalized answer relative to the links 
between the input, process, and output variables used in 
the study. 

The canonical loading for the significant variate 
are plotted in Figure 1. In the figure all the dependent 
variables are shown on the right-hand side. This variate 
indicates that the construct is characterized by high 
emphasis on cognitive achievement in mathematics. The 
other elements qualify the construct as denoting mathematics 
as being rather easy but mechanical, formal and fixed. 

On the predictive side are shown the elements with 
normalized beta weights larger than =.2^. Here the elements 
are high mathematical aptitude, apathy and high parental 
education. 

The nature of our data did not permit us to extract 
other canonical constructs. The content of the construct 
identified by developing this composite of predictors and 
dependent variables, is as follows i a group of students 
with high mathematical aptitude, relatively indifferent 
to what happens in the class, and from homes where parents 
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Attitude about difficulties 
of mathematics 



views about mathematics 
teaching 



Attitude . . .mathematics in 
Society 

Attitudes towards mathematics 
as a process 
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= .92 



FIGURE 1. Input and Process Variables as 
Predictors of Learning Criteria 
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are well-educated, are oriented toward learning mathematics, 
which they find is mechanical in nature and relatively easy. 

This construct identified by the canonical analysis is 
somewhat different from the characteristics Anderson (1971b) 
attributed to his sample of nine grade 10 or 11 mathematics 
classes in Montreal. In interpreting his data, he claimed 
that mathematics classes were quite different from the 
science, humanities and French classes. The mathematics 
Classes were characterized by high friction, favoritism, 
cliqueness, difficulty, lack of formality and perceived 
lack of democracy and disorganization. In the U.S., Flanders 
also finds that mathematics teachers are highly indirect 
(Flanders, 196^). The Ontario pattern appears to be more 
f ormal , 

On the basis of the data gathered for this report, we 
cannot verify all of Anderson^ s findings. Our data however 
is not inconsistent with what he has reported, but in this 
instance, our more conservative results are more probable. 
The reason for this is that the canonical variate selects 
beet predictors, whereas Anderson compared each of his 
'^asses on the basis of one variable at a time. 

II. CONCLUSIONS 
The purpose of this chapter was to report the antilysis 
of the data together with some interpretations. 
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Input and Output 

As expected, there is a high correlation between 
scholastic aptitude and achievement in mathematics. The 
correlation ranged from .62 to .86. Aptitude also is 
related to the class's attitude that mathematics and 
mathematicians are very important in our society. 

Two biographical variables are also significantly 
related to learning mathematics 3 education of parents 
(r = A8) and dislike for schooling (r - -.^1). Although 
the correlation is not statistically significant, students 
who do not discuss their career plans achieve better; 
since this biographical factor is also negatively related 
to scholastic aptitude, perhaps the correlation with 
achievement is spurious. None of the biographical variable 
are related to learning of attitudes. 

These input variables together account for 70% of 
the variance in cognitive achievement and 23% of the 
variance in the attitude that the field of mathematics 
is a developing one which calls for originality and under- 
standing (mathematics as a process vfir-.-ur, mathematics as 
a fixed, formal, mechanical system). 

These input variables, except one, are fixed and are 
not subject to the influence of the school,- the exception 
is "Dislike for schooling". Although it may in part be a 
social or cultural value, it probably was learned at school, 
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possibly as a result of continuous early failure. The 
child v/ho is not given an opportunity to achieve master v 
at his own level of development tends to dislike school. 

Since attitudes towards mathen:atics are) not related 
to input variables, we would expect that the role of the 
school be quite important in developing those attitudes. 

Process and Output 

Ten cf the fifteen learning environrr.ent scales are 
related to cognitive achievement, all of them in the 
expected direction. The results reflect the earlier 
findings of the Harvard Project Physics series of studies. 

The correlation between Difficulty and output seem 
strange at first {rlance. The R is .^6 (p<.05). Individual 
correlations between difficulty and mathena-cical aptitude 
and parenta]. education were positive (.41 and .31} respec- 
tively, indicating that perhaps better students v/ere in 
fact placed in more demandin/j mathematics classes. Another 
possibility is the fact that a teacher who sets hi^^h 
standards often achieves better results. This explanation 
iL5 plausible for the correlation between r:oal direction and 
difficulty is also significant (r = .37). 

Finally xhe theory of Jerome Bruner (i960) and the 
research by Logan (1973) demoiistrate that inquiry r.othods 
of teaching, althou.^h seeminp:ly more difficult, do lead to 
higher achievement. In this study, xhe correlation between, 
the students' description of the teaching method as r-ti-uia- 
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students to think about phenomena and develop principles 
(views about mathematics teaching) and achievement is 
also positive (r ^ ,48). Each of these three reasons 
would explain the correlation. 

It should also be noted that the correlations between 
the LEI scales and achievement reflect the advantages 
claimed for the Mastery Learning Model, It would appear 
that most teachers use some elements of the model. Certainly 
casual observation of classrooms would confirm this. 
However, we were not able to detect sufficient variability 
among teaching styles to be able to demonstrate links 
between its use or non-use. 

The lack of correlations between the measures of 
classroom climate and attitudes is puzzling. No other 
studies have yet reported on classroom climate and learning 
of attitudes about a subject. In the HPP, Walberg (1969a, b) 
reports correlations between interest in a subject and 
various LEI scales, principally Friction, Cliqaoness, 
Satisfaction and Apathy, However, the attitudes measured 
here do not indicate only interest, but indicate attitudes 
concerning the role and nature of mathematics, 

Input-Process-Outpu t 

There is some speculation that teachers do not cons- 
ciously pursue attitudinal objectives, Connelly (1972) 
in a study using a similar population of grade twelve 
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teachers in Eastern Ontario found that mathem^'*^ics teachers 
at that level used almost no such objectives ^tid did not 
evaluate the aohieveinent of those non-cognitiV^ objectives 
that they did have. Nevertheless these stuoei^'ts are not 
untypical^ Their average scores for attitude^ ^re more 
favorable than the average score of all the na'^^ions included 
in the international study by Husen (Husen, Vo^ 2i p. ^7). 
Once more our data shows little variability ^jyd thUs 
correlations are difficult to obtain. 

Does climate truly affect learning achi^v^^ent or are 
both factors determined by the input variabl^g^ The theory 
and our experience suggest that climate is imp^^^tant. Some 
evidence for this position is supplied by Walb^^g and 
Anderson (1972). Their simple correlations be*^een the LEi 
scales and achievement are similar to the ones ^^po^ted here. 
They then calculated partial correlations, whi^h in effect 
eliminated the influence of intelligence. The Partial 
correlations between achievement and the LEI s^^les were 
somewhat reduced but remained substantially un^J^anged and 
significant. 

Thus classroom climate, an amalgam of background, 
social values, teacher background and teaching styles, 
significantly affect cognitive achievement. 
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CHAPTER IV 



SUMMARY AND CONCLUSIONS 
I. SUMMARY 

The purpose of this study was to work toward a model 
of instructional supervision and to indicate to the 
supervisor the interconnections between various links in 
the educational process. This model indicates the points 
at which the supervisor should monitor the process and at 
which he can intervene in order to produce more satisfac- 
tory learning situations and outcomes. 

The educational model indicates that today, with 
present methods, social background factors of the student 
account for a great deal of learning. The most significant 
factor, of course, is intelligence. The purpose of the 
schools, th«y are to be maximally efficient, is to 
produce result.^ which indicate that each child is successful, 
thus reducing the impact of social background factors on 
achievement , 

Our management model is that of Likert '.'I967). His 
model includes the collective responsibility for achieving 
high goals, full and open communication to all levels of the 
organization, mutual trust among participants and shared 
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decision-making. Hall (1970) has already shown the link 

between the elements of this model and a school climate 

index-the organizational climate description questionnaire. 

An important element of the model is the sharing of 

goals. Chapter I outline the appropriateness and necessity 

for goals in teaching. While not accepting the recent 

Kettering Foundation Report (Brown, 1973) entirely, we are 

in sympathy with its statement that: 

Every secondary school and its subordinate 
departments must formulate a statement of goal s 
and develop performance criteria for students. 
Goals and objectives should bp published. 
(Brown, p. 13). 

This statement is in keeping with the demand for a 
new rationality in education. 

The study included approximately 1100 students, 48 
teachers and twelve schools in Eastern Ontario. The sample 
was limited to mathematics classes at the grades 9 and 10 
level . 

Figure 2 shows the major relationships found in this 
study. Mathematics achievement is a product of student 
characteristics and classroom characteristics. Although 
student characteristics do account for climate as well, it 
is reasoned that climate itself has a major independent 
contribution to make even under current practices. The 
most successful classes were characterized by high cohesi- 
veness, low friction favoritism and cliqueness, high 
satisfaction, low disorganization, high difficulty, low 
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1. Scholastic 
Aptitude 



2. Biographical 
Variables 



r = .82 




3 . Classroom 
Climate 



^. Achiewement 




5. Learned 

Attitudes about 
Mathematics^ 



FIGURE ' oUMIVIaRY OF RELATIONSHIPS' 
■^Relationships oetween other variables and the learned 
attitudes about mathematics tend to be low or not significant. 
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apathy and highly :jemocratic procedures. These findings 
are in conformity with earlier research. The findinjr: 
concerning difficulty was explained in Chapter III. 

The over-all picture of the mathematics classes 
surveyed is the construct yielded by canonical analysis, 
which indicates a mechanical, cognitive orientation with 
students who possess an aptitude for mathematics but are 
relatively uninterested in class activities. This is 
supported by other research which indicate?; a lack of 
concern on the part of teachers concerning the teaching 
cf mathematics attitudes and their dry uniform approach 
to the subject as characterized by low scores on the 
scale "diversity". 

II. SUPERVISION AND .'.:ASTERY LEAsHkIIkG 

Supervision and :.:astery Lea rninf^ . 

Classrooms serve as the point of contact between 

school systems and individual learners; it is at the 
level of the classroom that the educational effort comes 
to life. Thus, the evidence that approximately 20 per 
cent of the variance in learnin/: is accounted for by all 
classroom variables ^Greenfield, 1963) i^ ^-neaningful 
inforr;ation. Since this is variance thax e::cludes inpu- 
characteristics of learners, it represent- process variabl 
which can be manipulated by educators and supervisors to 
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improve the outcomes of education. In this sense, 
supervisors should assign priority to activities which 
focus on improving the learning environments of classrooms. 

The study reported in this paper focused on the 
classroom. It provided a conceptual model of an educational 
program at the classroom level in terms of inputs? processes, 
and outputs. In particular, the project focused on two sets 
of process variables, environmental and instructional, in 
an attempt to determine the impact of these variables on 
cognitive and attitudinal learning in mathematics classes. 

The Mastery Learning Model, an operational description 
of teacher behavior in typical group-based instructional 
situations, was used by the project team as a framework for 
demonstrating ways in which teaching behaviors could be 
changed to improve the environment of learning and, subse- 
quently, the cognitive and attitudinal behavior of students. 
The Mastery Learning Model is based on humanistic assumptions 
about human potential. The central thesis of the Model is 
that up to 95 per cent of the student population can master 
what we have to teach them. The teaching strategies 
specified by the model include formulating and communicating 
meaningful objectives, using criterion-referenced teaching 
and evaluation techniques, and utilizing diagnostic and 
prescriptive feedback followed by remediation. 
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The implementation of the model in a classroom should 
result in a classroom learning environment that is charac- 
terized by a cohesive group of students who are involved 
in organized goal-directed activities. The speed and level 
of difficulty of classroom activities would be matched to 
the educational needs of learners. The class would also 
be characterized by a lack of tension, disagreement, 
antagonism and apathy. The use of the model would also 
provide for democratic classroom procedures which would 
encourage student participation in making decisions about 
goals and activities; the result would be increased satis- 
faction and an increased liking for the subject. The use 
of the mastery strategy would minimize the development of 
divisive outgroups within the class, it would also provide 
for a diversity of materials and environmental experiences. 
Environmental characteristics such as the above could be 
expected to have an impact on both cognitive and attitudinal 
learning. Also, it must be recognized that the creation of 
these types of environmental characteristics is a worthy 
activity in its own right. 

The fact that the data obtained in the study did not 
provide any evidence relative to a direct link between the 
use of the Mastery Model and learning does not detract 
from the theoretical and practical validity of the Mastery 
Model as a classroom-oriented framework that provides a 
strategy for changing many relevant classroom variables. 
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The same statement made relative to the observation 

that only a small nuiflber of teachers were able to implement 
all elements of the iflOdel. However, these results do 
provide support for I^ikerf s claim that time is an important 
variable in changing organizational variables (Likert, I967) 
and Weiss' claim tha,-fc schools have reached a level of 
development to the ^o^ht Where the marginal utility of 
additional change-o^-jehtecj efforts becomes smaller (Weiss, 
1974). 

In other words, it is evident that instructional 
supervisors have to consider time and the marginal utility 
of efforts in addit^oA to the content and characteristics 
of change-oriented pr<^§rains. Resources are required so 
that supervisors are ^bie to follow an innovation over 
time using every av^i],^ble leadership and technical skill. 

While evidence of a direct relationship between the 
use of the Mastery Learning Model and learning was lacking, 
the study did provide evidence indirectly in the sense that 
the environmental characteristics that a mastery strategy 
v/ov d be expected to create were related to certain learning 
criteria. Environmeh-tal characteristics that were related 
to cognitive learning criteria included a tightly-knit 
social group, a varie-fcy of materials and resources, an 
emphasis on democratic ciaf?sroom processes, - feeling of 
concern on the part of Stuc^ents for classmates, satisfaction 
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on the part of students, and goal-directed activities 
which were associated with treating students equally. 
These are environmental characteristics which theorists 
associate with situations that provide for student self- 
actual izatior. (Stern, 1970). In other words, the Mastery 
Learning Model, provides a meaningful model of classroom 
management which could have an impact not only on tradi- 
tional learning criteria, but also on significant process 
variables in the classroom. 

A general statement relative to the results is that 
cognitive learning criteria played a major role in terms 
of significant relationships. Most educational theorists 
agree that the manifest goals of schools are primarily 
cognitive and that there is a need to recognize affective 
and attitudinal outcomes of education. The fact that the 
highly generalized results i.e. canonical analysis, of the 
study indicated that mathematics classes were cognitive in 
orientation deserves some attention. One possibility for 
the failure to demonstrate relationships with non-cognitive 
criteria is the quality of the instrumentation used to 
measure attitudes toward Mathematics. The results obtained 
in this study were similar to the results obtained in the 
International Study of Achievement in Mathematics (Husen, 1967 
since Husen was also unable to discriminate on the basis of 
the scales, the instruments should be tested further before 
they are used in further research. 
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The quality of the instrumentation relative to 
attitudes not withstanding, the fact remains that mathe- 
matics classes are primarily cognitive places. The gene- 
ralized picture is an emphasis on product learning in the 
cognitive domain; the developement of attitudes toward 
mathematics as an exciting discipline appears to have 
lower priority than the acquisition of knowledge. While 
a portion of this orientation can be accounts r for by the 
contribution of secondary school educators, it must be 
recognized that secondary school students would likely 
have developed a "mental set" toward mathematics as a 
result of experiences with mathematics during the first 
eight years of schooling. It seems possible that this 
set of student expectations could be a factor which 
contributes to the cognitive orientation of secondary 
school mathematics classes. 

The implications for instructional supervision are 
significant. Secondary school mathematics teachers are 
not in a position to drastically modify student expectations 
However, curriculum supervisors are in a position to develop 
monitor, and influence classroom learning in the^^r coordina- 
tion roles p Only the supervisor can provide the mechanisms 
which will result in articulated school experiences from 
grade to grade and from elementary schools to secondary 
schools. In this sense, the results of this project indicat( 
that an important area of future supervisory activity is to 
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place priority on developing learning environments which 
have an impact on the development of attitudes. 
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1. LEARNING ENVIRONMENT INVENTORY 

2. BIOGRAPHICAL INVENTORY 

3. MATHEMATICS CLASS INVENTORY 



90 

o 

ERIC 



LEARNING ENVIRONMENT INVENTORY 

University of Ottawa 
DIRECTIONS 

The purpose of the questions in this section of the booklet is to find out what your class is like. 
This is not a "test". You are asked to give your honest, frank opinions about the class vvhich 
you are now attending. 

Recurd your answer to each of the questions on the answer sheet provided. Please do not mark 
this booklet. Answer every question. 



In answering each question go through the following steps 

1. Read the statement carefully. 

2. Think about how well the statement describes your class 
(the one you are now in). 

3. Find the number on the answer sheet that corresponds to 
the statement you are considering. 

4. Blacken one space only on the answer sheet according to 
the following instructions: 

If you strongly disagree with the statement, blacken :pace A. 

If you disagree with the statement, blacken space 

If you agree with the statement, blacken space C. 

If you strongly agree with the statement, blacken space D. 

5. You will have approximately 40 minutes to complete the 
questions in this booklet. Be sure the number on the 
answer shfjet corresponds to the number of the statement 
being answered in the booklet. 

The first 105 statements in this booklet are based on the Learning Environment Inventory 
developed for research purposes at Harvard University by Dr. Herbert J. Walberf;.3nd 
Dr. Gary J. Anderson. 
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1. 


Members of the class do favours for one another. 


A 


B 


c 


D 


2. 


The books and equipment students need or want are easily 
avaiiaDie lo inem in tne classroom. 


A 


B 


n 


D 


3. 


There are long periods during which the class does nothing. 


A 


B 


C 


D 


4. 


The class has students with many different interest^. 


A 


B 


C 


D 


R 
^* 


Certain students work only with their close friends. 


A 


B 


c 


D 


6. 


The students enjoy their class work. 


A 


B 


c 


D 


7. 


Students who break the rules are penalized. 


A 


c> 




n 
u 


8. 


There is constant bickering ar^iong class members. 


/\ 


R 




n 
u 


9. 


The better students' questions are more sympathetically 
answered than those of the average students. 


A 


B 


c 


n 


10. 


The class knows exactly what it has to get done. 


A 


R 




n 


11. 


Interests vary greatly within the group. 


A 


B 


c 


D 


12. 


A good collection of books and magazines is available 
in the classroom for students to use. 


A 


B 


c 


D 


13. 


The work of the class is difficult. 


A 


B 


c 


D 


14. 


Every member of the class 3njoys the same privileges. 


A 


B 


c 


D 


15. 


Most students want their work to be belter than their 


A 


B 


c 


D 


16. 


The class has rules to guide its activities. 


A 


B 


c 


n 


17. 


Personal dissatisfaction with the class is too small to be a problem. 


A 


B 


c 


D 


(8. 


A student has the chance to get to know all other students in 
the class. 


A 


B 


c 


D 


19. 


The work of the class is frequently interrupted when some 
Sluuenis nave noining to do. 


A 


B 


c 


D 


20. 


Students cooperate equaMy with all class members. 


A 


B 


c 


D 


21. 


Many students are dissatisfied with much that the class does. 


A 


B 


c 


D 


22. 


The be' ::jdents are granted special privileges. 


A 


B 


c 


D 


23. 


The ob: actives of the class are not clearly recognized. 


A 


B 




D 


24. 


Only the good students are given special projects. 


A 


B 


c 


D 


25. 


Class decisions ten:* ,1 1: - r-^ade by all the students. 


A 


B 


c 


D 
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26. 


The students would be proud to show the classroom 


A 


R 




n 




to 3 visitor. 










27. 


The pace of the class is rushed. 


A 


B 


c 


D 




Some students refuse to mix with the rest of the class. 


A 


B 


c 


D 


29. 


Decisions affecting the class tend to be made democratically. 


A 
r-\ 


B 


c 


D 


X. 


Certain students have no respect for other students. 


A 


B 


c 


D 


'31 
O 1 . 


Some groups of students work together regardless of what 


A 


B 


c 


D 




the rP*lt of thp 'iQQ f^olnn 










32. 


Members of the class are personal friends. 


A 


B 


c 


D 


33. 


The class is well organized. 


A 


B 


c 


D 


34. 


.Some students are interested in completely different things 


A 
A 


B 


c 


D 




than other stuHents 










35. 


Certain students have more influence nn thp rla<;<; than nthprQ 


A 


□ 




n 
u 


36. 


The room is bright and comfortable. 


A 


B 


c 


D 


37. 


Class members tend to pursue different kinds of problems. 


A 


B 


c 


D 


38. 


There is considerable dissatisfaction with the wnrk nf thp pIpqc 


A 


□ 


p 


n 


39. 


Failure of the class would mean little to individual members. 


A 

A 


p 


p 


n 
u 




The class is disorganized. 


A 


B 


c 


D 


41 


Students compete to who can do the best work. 


A 


B 


c 


D 


42. 


Certain students impose their wishes on the whole class. 


A 


B 


c 


D 


4?. 


A few of the class memher*; alwavs trv tn Hn hpttpr than 


A 


p 




Lf 




the others. 










44. 


There are tensions among certain groups of students that tend 


A 


B 


c 


D 




to interfere with class activities. 










45 


The class i' well-organized and efficient. 


A 


B 


c 


D 


4d. 


Students are constantly challenged. 


A 


B 


c 


D 


47. 


Students feel left out unless they compete with their 


A 


B 


c 


D 




r*! acc matoc 
^ 1 1 1 la Lcb . 










48. 


Students are asked to follow strict -iles 


A 


B 


c 


D 


49. 


The class is controlled by thf' actions of a few members who are 


A 


B 


c 


D 




favoured. 










50 


Stiicients don't care aljout ihp ' .cire of the class as a group. 


A 


B 


c 


D 
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Strongly 


Disagree 


Agree 


Strongly 


51. 


Each member of the class has as much influpnce a<; anv 
other member. 


A 


3 


r 


n 


52. 


The mennbers look forward tn coming class meetiiigs. 


A 


B 


C 


D 


53. 


Tht' s<.ibiect stucJied reouires no rwrtirular antltuHp nn tho nai t 
of the students. 


A 

M 


Q 

D 


L 


D 


54. 


Members of the class don't care what the class does. 


A 


B 


C 


D 


55. 


1 iici die uibpidyb arouno ine room. 


A 


B 


C 


D 


56. 


All students know each other very well. 


A 


B 


C 


D 


57. 


The classroom is too crowded. 


A 


B 


C 


D 


58. 


Students are not in close enough contact to develop likes or dislikes 
for one another. 


A 


B 


c 


D 


59. 


The class is rather informal and few rules are imposed. 


A 


R 

LJ 


c 


n 


60. 


Students have little idea of what the class is attempting 
to accomplish. 


A 


B 


c 


D 


61. 


Thera is a recognized right and wrong way of going about 
class activities. 


A 


B 


c 


D 


62. 


What the class does is determined by all the students. 


A 


B 


c 


D 


63. 


After the class, the students have a sense of satisfaction. 


A 


B 


c 


D 


64. 


Most students cooperate rather than compete with one another. 


A 


B 


c 


D 


65. 


The objectives of the class are specific. 


A 


B 


c 


D 


66 


Students in the class tend to find the work hard to do. 


A 
A 


D 

D 


c 


D 




Each student knows the goals of the course. 


A 


D 




U 


6o. 


AM classroom procedures are well-established. 


A 


B 


c 


D 


69. 


Certain students in the class u. e rejiponsible for petty 
quarrels. 


A 


B 


c 


D 


70. 


Many c'^-^: r.iembers are confused by what goes on in class. 


A 


B 


c 


D 


71. 


The class is made up of individuals who do not know each 

r\t ho r wv/P 1 1 


A 


B 


c 


D 


72. 


The class divides its efforts arnona spvpral nurnoQpQ 


A 


B 


c 


D 


73. 


The class has plenty of time to cover the prescribed amount 
of work. 


A 


B 


c 


n 


74. 


Students who have past histories of being discipline problems 
are discriminated against. 


A 


B 


c 


D 


75. 


Studcnts do not have to hurry to finish their work. 


A 


B 


c 


D 
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Certain groups of friends tend to sit together. 
There is much competiti in the class. 

The subject presentation ib too elementarv for many students. 
Students are well-satisfied with the wor k of the class. 
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A few members of the class have: much greater influence than 
the other members. 



There is a set of rules for the students to follow. 

Certain students don't like other students. 

The class realizes exactly how much work it has to do. 

Students share a common concern for the success of the 
class. 

There is little time for day-dreaming. 

The class is working toward many different goals. 
The class members feel rushed to finish their work. 
38. Certain students are considered uncooperative. 

Most students sincerely want the class to be a success. 
There is enough room for both individual and group work. 



• Each student knows the other members of the class by their first names. 

^2. Failure of the class woMld mean nothing to most members. 

^2- The class has difficulty keeping up with its assigned work. 

There is a great deal of confusion during class meetings. 

Different students vary a great deal regarding which aspect 
of the class they are interested in. 

Each student in the class has a clear idea of the class goals. 
Most students cooperate equally with other class members. 
Certain students are favoured more than the rest. 
Students have a great concern for the progress of the class. 
Certain students stick together in small groups. 
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Strongly 


Disagree 


Agree 


Strongly 
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A 
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A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 




D 


A 


B 


c 


\) 


A 
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A 
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101 . Most students consider the subject-nnatter easy. 

102. The course material is covered quickly. 

103. There is an undercurrent of feeling among students that 
tends to pull the class apart. 

104. Many students in the school would have difficulty doing 
the advanced work of the i iob.. 

105. Students seldom compet' '.th one another. 

We wish to check whe re marking your responses beside the 

right numbers on youi sheet. To assist us please mark as 

follows: 

106. Mark A 

107. Mark B 

108. MarcC 

109. Mark D 

110. Mark E 
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BIOGRAPHICAL INVENTORY 



University of Ottawa 
DIRECTIONS 

The purpose of the questions in this section of the booklet is to obtain information about you. 
Please answer each question sincerely and accurately. 

Record your answer to each of the questions on the same answer sheet as you used for the 
questions in the first part of this booklet. Please do not mark on this booklet Answer every 
question. Be sure the number on the answer sheet corresponds to the number of the 
statement being answered in the booklet. 

Now go to number 1 1 1 apd answer every question as well as you can. 

111. State your sex. 

A. boy 

B. girl 

112. How old are you ? 

A. 12 or younger 

B. 13 

C. 14 

D. 15 

E. 1 6 or older 

113. What is the highest level of your father's education? 

A. elementary 

B. some high school 

C. high school 

D. some university or community college 

E. university degree 

1 14. What is the highest level of your mother's education? 

A. elementary 

B. some high school 

C. high school 

D. some university or community college 

E. university degree 

115. Your last year's final average for all subjects was about 

A. 80 percent or higher A, A-) 

B. 65 percent to 79 percent (B+, B, B--) 

C. 50 percent to 64 percent (C+, C, C-) 

D. any grade or mark jijwer than the above 

116. What is the highest level of education you expect to have actually attained 
fifteen years from now? 

A. not finished high school 

B. high school graduate 

C. community college graduate, registered nurse, etc. 

D. university degree, e.g., B.A., B.Ed., B.Sc. 

E. professional degree, e.g., doctor, lawyer, Ph.D. 

^7. What yearly income do you expect to actually make fifteen years from now? 

A. below $6,000 

B. $6,000 to $8,999 

C. $9,000 to $11,999 

D. $12,000 to $15,000 

E. more than $1 5,000 9 7 
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118. Among the things you strive for during your high school days, which of the 
following is most important to you? 

A. pleasing your parents 

B. learning as much as possible in school 

C. living up to your religious ideals 

D. being accepted and liked by other students 

E. pleasing the teacher 

1 19. How many evenings a week do you spend with the gang? 

A. none 

B. one 

C. two 

D. three 

E. more than three 

120. How much time, on the average, do you spend doing homework outside the 
school on a weekday? 

A. none or almost none 

B. less than one hour 

C. one or two hours 

D. two or three hours 

E. more than three hours 

121. In relation to all the subjects you are studying this year, mathematics is the 
subject which you 

A. very frequently enjoy 

B. often enjoy 

C. sometimes enjoy 

D. rarely enjoy 

122. How often do you discuss career plans with guidance counsellors? 

A. rarely 

B. sometimes 

C. often 

D. very frequently 

123. How often do you discuss career plans with adults other than guidance 
counsellors? 

A. rarely 

B. sometimes 

C. often 

D. very frequently 

124. Do you like school? 

A. yes 

B. no 

* These items were not used in our analyses. 
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MATHEMATICS CLASS INVENTORY 



University of OLLowa 
DIRECTIONS 
N - 519 

The following questions are concerned with your inn Llioina tics class 
since the l)(?r|innin(j of the? second L(?nn , Pleijsc think of your 
mathematics class as you answer each question. 

Record your answer to each of the questions on the same answ(?r sh(?et 
as you used for tho questions in the first part of this booklet, 
I'lease do not mark on this booklet. Be sure the number on the 
answer sheet corr(jsponds to the number of the statement being answered 
in the booklet. 

Now go to number 71 and answer every question as wt?ll as you can. 



71, ilow many short tests in mathematics have you had since 
the beginning of the second term? 

A. one 5.4% 

B. two 14% 

C. three 25.6% 

I). four or more 51.7% 
ii. none 5.5% 



72. Did the scores on these short tests count in some way 
towards your final mark? 

A. always 58. 7^^ 

B. sometimes 27,5% 

C. never 1 • 7% 

D. do not know 12.fo 



In cases wliere you had mistake.^ in these sliori tests, 
were? you given assistance or direction to iielp you 
improve your understanding? 

A, always 51.^% 
li. sometimes 38 ,2% 
C\ never 10 A% 



74. Ui(] you find that these short tests in mathematics 
were helpful to you? 



A. yes 83.5% 
5.5% 

1)9 



"° 16.5% 



When a new unit or chapter was introduced, were 
you made aware of the objectives for the unit or 
chapter? 

A. yes 7996 

B. no 2196 



If your answer to 75 above was "yes", did you find that 
knowing the objectives of the chapter or unit was helpful 
to you? 



A. yes 79?5 

B. no 2I9S 



PLEASE CHECK TO SEE IF YOUR SCORING HAS BEEN NEATLY 
PENCILED IN. 
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WORKSHOP EVAXUATION 
QUESTIONNAIRES AND RESPONSES 
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WORKSHOP EVALUATION QUESTIONNAIRE AND '^'^ 
SUMMARY OF DATA FROM SIX SCHOOLS 



Please check each of the following items. Peel free to write 
additional comments beside any of them. 



I 



1. The overall quality of the presentations at the workshop 
v/as I 

^.EXCELLENT 22__C00D l6_AVERAGE ^FAIR ^POOR 2_N0 RESPONSE 

2. The language level of the workshop presentations wasi 
l_VERy DIFFICULT ^^DIFFICULT i^ABOUT RIGHT ^TOO EASY 

3. How good were the meeting room facilities for the workshop? 
2_VERy GOOD 3£G00D 10_P00R J_VERY POOR 1_N0 RESPONSE 

4. Was the tiine allowed for the workshop sufficient to learn 
the materials? 

ll^NO 1_N0 RESPONSE 

5- The pace at which the workshop was conducted was 1 

3_T00 FAST 3IABOUT RIGHT IITOO SLOW 

6. The sequence of activities during the workshop v/as 1 

_VERy CONFUSIfiG l^CONFUSING £9EASY TO UNDERSTAND 2_N0 RESPON 

7« Your feeling during the workshop can best be described asi 

_YERY FRUSTRATED 12.FRUSTRATED 2X.NEUTRAL 2^EAGZR ^NO RESPONS: 

8. Did you have prior exposure to the concepts presented on 
instructional objectives? 

iL.OUITE A LOT 3£.S0ME UNONE AT ALL 
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9- 

9. Did you have prior exposure to the concepts presented on 
fonnative evaluation? *- 



J.QUITE A LOT 28__s6mE liLNONE AT ALL 

. 10. During the workshop, did you wish to discuss instructional 
proDlems that had arisen in your work? 

24. YES 16_N0 ^NO RESPONSE 

11. If answer, tb item 10 above was "YES", was there an 
opportunity to pursue this interest? 

I ■ 

8_QUITE A LOT l6_S0ME JONE AT ALL 

12. Did the amount of time provided for discussion during the 
workshop seem acceptable? . 

LJ?00 MUCH 31„JUST RIGHT ^TOO LITTLE 1_N0 RESPONS 

13. Did the amount of problem solving required durine the 
workshop seem acceptable? 

L.TOO MUCH 19.JUST RIGHT 12.T00 LITTLE 12N0 RESPONSE 

14. Vfill you use what you have learned in the immediate 
future? ■ 

3iL-YES l^NO 10.N0T SURE 

15. Would you like to learn more about instructional objectives 
as defined in the workshop? 

•22YES 13_N0 ^NO RESPONSE 

16. Would you like to learn more about fcrmative evaluation as 
defined in tne workshop? 

3iJ_YES 9 NO 2 m RESPONSE 
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Did you develop solutions to any instructional problems 
during the workshop? 

16__YES 2^N0 ^NO RESPONSE . 

How would you describe the correspondence between what you 
expected to get out of the vvorkshop and what you actually 
did get out of the workshop? 

22_/B0UT V.mT I EXPECTED 

IS^MORE THi*.N I EXPECTED 

^LESS THAN I EXPECTED 

2_N0 RESPONSE 

What would you like to see changed in the workshop and how 
would you change it? What would you add or delete? 



104 



94 



Coir.plcte tho tabic below by placing checks in each colunin to 
indicate your feeling about various taisks. 





As a result of my attendance at the workchopi 


TASK 


I am able to attack 
this task more 
effectively. 


I see iiTiinediate 
practical application 
cf the technique. 




YES 


NO 


YES 


NO 


a. Determining the 

characteristics of 
an instructional 
objective. 










b.. Writing an 

instructional 
objective. 


— — 









c. Plarining a program 
which utilizes 
instructional 
objectives. 






— 




CL • i-^exermjining xno 

nature of formative 
evaluation. 










e« Determining the 

role of the teacher 
in utilizing 
instructional 
objectives • 










f. Planning a program 
which utilizes 
formative 
evaluation. 










ge Determining tho 
use of instruc- 
tional objectives 
in planning a 
formative 

evaluation program. 
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APPENDIX C 
LIST OF PARTICIPATING SCHOOLS 
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APPENDIX C 



PARTICIPATING SCHOOLS 

1. Arnprior District High School 
Arnprior, Ontario 

2. Brookfield High School 
Ottawa, Ontario 

3. Colonel By Secondary School 
Ottawa, Ontario 

4. Gloucester High School 
Ottawa , Ontario 

5. Fisher Park High School 
Ottawa, Ontario 

6. Lisgar Collegiate Institute 
Ottawa, Ontario 

7. MacKenzie High School 
Deep River, Ontario 

8. Perth District High School 
Perth, Ontario 

9. Rideau High School 
Ottawa, Ontario 

10. Sir John A. Macdonald High School 
Ottawa, Ontario 

11. Sir Wilfred Laurier High School 
Ottawa, Ontario 

12. Smiths Falls District Collegiate Institute 
Smiths Falls, Ontario 
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APPENDIX D ' 
DESCRIPTIVE STATISTICS 
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TABLE VII 



Means and Standard Deviations of 
the Class Means for the School and 
College Ability Test (SCAT Series II) 



N = 48 . 




MEAN 


S.D. 


Verbal 


265.67 


14.36 


Mathematical 


282.47 


13.72 


Total 


274.58 


10.83 
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TABLE VIII 



Means and Standard Deviations of the 
Class Means for the Biographical Invent 

(N = 48) 



SCALE 



MEAN 



Parental 
Education 

Dislike for 
School 

Career 
Planning 



5.96 
9.64 
3.63 
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TABLE IX 

Means and Standard Deviations of the 
Class Means for the Fifteen Scales of 
the Learning Environment Inventory (LEI) 

(N = 48) 

LEI 

SCALES MEAN 



1. 


Cohesiveness 


18.93 


1.39 


2. 


Diversity 


20.36 


»V2 


3. 


Formality 


17.85 


1.17 


4. 


Speed 


17.73 


1.60 


5. 


Environment 


17.30 


1.31 


6. 


Friction 


17.48 


1.75 


7. 


Goal Direction 


18.64 


1.31 


8. 


Favoritism 


14.34 


1.50 


9. 


CliquenesB 


18.61 


1.36 


10. 


Satisfaction 


17.33 


1.73 


11. 


Disorganization 


15.69 


2.05 


12. 


Difficulty 


18.88 


.99 


13. 


Apathy 


17.11 


1.75 


14. 


Democratic 


17.33 


1.07 


15. 


Competitiveness 


17.86 


1.24 
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TABLE X 



Mean and Standard Deviation of 
the Class Means for the Stanford 
Achievement Test, Mathematics - Part A. 



MEAN s.D. 



Stanford 
Achievement 
Test, Mathematics 
Part A 



23.58 4.44 
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TABLE XI 



Means and Standard Deviations 
of the Class Means for the Four 
Scales of the School Mathematics Inventory 

(N = 48.) 



SCALE MEAN 



Views About 
Mathematics Teaching 

Attitudes About the 
Difficulties of 
Learning Mathematics 

Attitudes Toward the 
Place of Mathematics 
in Society 

Attitudes Toward 
School and 
School Learning 



12.45 
10.90 
9.56 
11.53 



1.3^ 
.93 
1.35 
1.30 
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APPENDIX E 
TECHNICAL NOTES ON THE 
STATISTICAL METHODS EMPLOYED 
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Some Technical Notes on Statistics 

The purpose of this appendix is to provide a few additional notes 
on the use of statistics in this report. Part one reviews the rationale 
for grouping the data into class means. Part two is a review of the 
correlational methods employed. The advanced reader will find sane of this 
very elementary, but it is presented for the benefit of the reader who has 
no background in statistics. 

I. Classroom Scores 
One of the first questions in research refers to the target of 
research: pupil, the class, the teacher, the school, or some other 

unit of analysis. While the individual pupil is important in educational 
research, whereas the school as a unit is often an important factor, 
the focus of this study is the classroom. 

7o base our analyses on the scores of individuals would be 
inappropriate. Learning is influenced greatly by classroom factors: the 
teacher, the presence of one or more unruly students, the time of day a 
class is scheduled. Further, another of the important variables, is clearly 
a class measure: the learning environment inventory (LEI). Although each 
student gives his or her perception of the climate, that student is also 
a part of that class. Thus the scores of individual members of any group 
in a climate study are not strictly independent. The class average is the 
best estimate of the collective perception of climate. Consequently our 
data is grouped into classroom units, and most of the tests conducted were 
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based on the assumption that there were 48 individual units, as 48 class- 
rooms participated in the study. 

The appropriate test for reliability of the scales is the intra- 
class correlation which is based on the ratio of between-class variance to 
within-class variance: 

"It indicates both the extent to which pupils within the same 
class respond similarly and the extent to which the scale discriminates 
among classes."-^ 

Similarly, the other measures were grouped into class means because 
we required characteristics of the class, and results of classes so that 
programs, rather than pupils, could be evaluated. Again, the appropriate 
unit of analysis was the classroom. 

II. Statistics 

Correlation: r 

The most frequent statistic in this report is the correlation, 
which indicates the degree of relation between two sets of scores. For 
instance achievement in mathematics is related to aptitude for mathematics. 
The class with many students with a high aptitude will usually have the 
highest achievements. If the 48 classes in our sample were perfectly 
matched on these two variables, then the correlation would be perfect 
(r=l. 00). If there were same discrepancies, for instance an usually good 



1 Gary Anderson, The Assessment of Learning Environments : A 
Manual for the Learning Environme nt Inventory and the My Cla ss Inventory. 
Halifax, Atlantic Institute of Canada, 1971, p. 12 
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teacher obtained superior results from an average class , then the correlation 
would decrease. If no relation existed between these two sets of scores, 
then the correlation would be zero (r = .00). If, by some perverse 
circumstance, classes with low aptitudes achieved the highest scores, then 
the correlation would be negative, e.g. r=-.45. 

Correlations are only as accurate as the tests used to measure the 
variables. An instrument with less than perfect reliability will usually 
cause a correlation to drop and thereby underestimate the true nature of the 
relationship. 

Although the correlation is only a measure of association, historical- 
ly it has been used to predict. TTius, in this example, we can use aptitude 
scores to predict achievement scores. Predictions can be made on the basis 
of true experimental results or on theoretical grounds. In an experiment, it 
can be shown that adding varying amounts of chemicals to soil samples produces 
fruit of varying sizes. Thus the presence of these chemicals predicts the 
later appearance of larger fruits. In the classroom, certain teaching styles 
may be associated with improved learning, it may be difficult to prove that 
there is a causal connection between the two, but theory may strongly support 
such a contention. 

Mathematically, correlation is a measure of shared or common variance. 
On occasion, researchers do not find correlations between two sets of scores, 
because of a lack of variance. For instance, if all students obtained the 
same mark on a test, this lack of variance would yield a correlation of zero. 
If all marks clustered narrowly about one score, this relatively small 
variance would make it difficult to detect a correlation. 
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A correlation is a measure of co,mo„ variance. The proportion of 
shared variance is obtained by squaring the correlation coefficient- r^ 
A correlation of .5 between an aptitude test and success in a task indicates 
that the test accounts for 25 per cent of the variance in the success scores. 

"hen is a correlation significantr Social scientists are usually 
confident that there is a true association between two variables when there 
- a .95 Chance (19 out of 20) that the relationship is real, lhat is the 
probability is less than 5* (p<.„5, that totally unrelated sets of scores 
"ould. by chance, obtain a correlation as large. 

T>.e level of confidence is related to the si.e of the sample In 
this report, since we have 48 classrooms, correlations greater than .29 or 
less than -.29 are accepted as significant and true (df 46, p. OS- .28S, two- 
tail test) . 

Partial correlation 

If two variables, height and reading achievement in children are 

"•ated. r = .8. it .ay be because these two items are related to a third 
factor^age. Partial correlation is „ technique of measuring the relationship 
between two factors, after subtracting the con-on variance they share with 
a third variable. Ihus in this case, since both height and reading ability 
.n chrldren are related to age, the partial correlation between the two 

would probably be reduced to z^rn n, , 

to zero. The partial correlation is otherwise 

interpreted as an r. 
Multiple Correlation: R 

several factors, e.g. a battery of tests, are related to a 
^ingle variable, then the multiple correlation is used. Ihis is an index 
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of association between a sejt of predictors and one criterion. In this study, 
the fifteen LEI scales were used to predict mathematics achievement. 
Statistical methods are available to calculate the contribution of any of the 
predictor variables. 2 The R can be interpreted in a manner similar to r. 
R is an indicator of the shared variance between the set of predictors 
and the criterion. The significance levels of R is usually larger than r. 
Canonical Correlation Rc 

This relatively new and most complex technique is used to relate a 
set of predictors to a set of dependent variables, e.g. 15 LEI scales to 
4 attitude scales. Although the method was developed in 1935 by Hotelling, 
it is still infrequently used. It identifies elements of one set of 
variables that are most highly related to elements of the other set. 3 it 
takes into account the correlations of variables within each set as well 
as the correlations between the sets. The result is two variates, a 
predictor and a criterion, between which there is the greatest possible 
correlation. 

The result is a construct which must be interpreted. This is 
accomplished by examining the relative weights of each element within the 
two variates. These weights also express the correlation between the variate 
and the individual variables.^ 



A D ? '^^?;''^n'* '^"lingto"' "Multiple Regression in Psychological Research 
and Practice", P sychological Bulletin . 69, pp. 161-182, 1968. 

3 Maurice Tatsuoka, Multivariate Analysis . Toronto, John Wiley, p. 183, 



1971. 



4 R.D. Bock and E.R. Haggard, "The Use of Multivariate Analysis of 
Variance in Behavioral Research," in D.K. Whitta, editor. Handbook of Meas ure- 
ment and Assessment m the Behavioral Sciences . Reading, Mass., Addison-Wesley , 
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Generally, one canonical correlation is not sufficient to explain 
all relationships. Two or three pairs of variates are usually identified. 
The reader will note that only one Rc was significant in this study, possibly 
leading to an incomplete description. 
Computer Programs 

The data was tested, for the most part, with the aid of the 
University of Ottawa computer program library. All the tests in this report 
were calculated on programs which were derived from the Biomedical Computer 
(BMD) Library Program of the University of California at Los Angeles. 
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